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TECHNICAL FIELD 

The present invention generally relates to the field of watermarked media 
signals and the detection of watermarks embedded in media signals. More particularly the 
present invention is directed towards a method, apparatus and computer program product for 
5 enabling at least identification of data sjmbols that have been embedded in a media signal by 
quantization of a host signal. 

DESCRIPTION OF RELATED ART 
10 It is well known to watermark media signals in order to protect the rights of 

content owners against piracy and fiaud. 

Two such watermarking schemes are Ihe so-called QIM (Quantisation Index 

Modulation) and DC-QIM (distortion-compensated Quantisation Index Modulation) 

watermaddng schemes, where a watermark is embedded in a so-called host signal by 
15 choosing sample values on a sampling grid la order to get a better statistical reseniblance to 

the original signal after watermarking, it is then common to add dither to the watermarked 

signal. 

However, when such a watermarked host signal is transmitted to a receiver, 
the scaling fectors used can get rescaled, which scaling fector is proportional to the 

20 quantisation step size. Since the quantisation step size is then incorrect tiie detection of a 
watermark is hard ot even impossible to perform. Such rescaling of the scaling factors can 
take place because of various reasons, such as the properties of the transmission channel 
used. One reason can be that the channel is an analogue channel with an unknown gain 
factor- Another reason can be an attack on the signal by a malicious party. 

25 WO 03/052689 describes one way to retrieve scaling fectors from a received 

possibly rescaled host signal. In this document received signal san5)les are divided into three 
dijfferent dither value intervals. Histograms are tiien created using partial probability density 
functions for the signal samples in each interval, and the origmal scaling fector as well as a 
DC ofifeet can be obtained through analysing tiiese three histograms. Signal samples are thus 
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piovided together in groups with many varied dither values before analysis, which means that 
some infomiation in the signal sample might not be used for determining the scaling &ctors. 
This document also mentions lhat a pilot signal is used in the lettieval of the scaUng j&ctors. 

It would however be advantageous to have an alternative way of determining 
scaling fectors of a received media signal that can use more information in the different 
signal sansples for the determination of this scaling ^stctor. 



SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide an alternative way 
of determining scaling factors of a received media signal that uses more information in 
receiYedsigMl s.amples.than what is, done-w^ 

According to a first aspect of the present invention, this object is achieved by a 
method of enabling at least identification the presence data symbols that have been embedded 
in a media signal comprising the steps of: 

obtaining a transmitted media signal, which comprises a possibly distorted 
v^ion of a host signal in which data symbols have been enibedded by quantisation using a 
certain quantisation step size and to which dither with a set of dither values has been added, 

providing several dither value intervals within the set, where each interval 
corresfponds to one or a small number of dither values, 

determining a histogram for each dither value interval, where a histogram is 
determined for all sample values of a set of signal samples of the transmitted media signal 
and having a dither value in the corresponding dither value interval, 

combining the separate histograms corresponding to the intervals into a single 
histogram, and 

determining at least a rescaling fector based on the combined histogram in 
order to estimate the quantisation step size. 

According to a second aspect of the present invention, this object is also 
achieved by an apparatus for enabling at least identification the presence of data symbols that 
have been embedded in a media signal and comprising: 

a signal obtaining unit arranged to obtain a transmitted media signal 
comprising a possibly distorted version of a host signal in which data symbols have been 
embedded by quantisation using a certain quantisation step size and to which dither with a set 
of dither values has been added, and 



PHNL031463EPP 



3 09.12.2003 

a signal distortion detennining unit ananged to: 

provide several diHier value intervals within the set, where each interval 
coir^ponds to one or a small number of dither values, 

determine a histogram for each dither value interval, where a histogram is 
deteimined for all sample values of a set of signal saniples of the transmitted media signal 
having a dither value in the corresponding dither value mterval, 

comibine tibie separate histograms corresponding to the interval into a smgle 

histogram, and 

deteimine at least a rescaling fiictor based on the combined histogram in order 

to estimate the quantisation step size. 

According to a tiiird aspect of the present invention, this object is also 
achieved by a computer program product for enabling at least identification the presence data 
symbols tiiat have been embedded in a media signal, comprising a compatec readable 
medium having thereon: 

computer program code means, to make the compute do, when said program 

is loaded in the computer: 

for an obtained transmitted media signal comprising a possibly distorted 
version of a host signal m which data symbols have been embedded by quantisation usmg a 
certain quantisation step size and to which ditiier witii a set of dither values has been added, 

provide several ditiier value intervals within the set, where each interval 
conesponds to one or a small number of dither values, 

deteimme a histogram for each dither value mterval, where a histogram is 
determined for all sample vahies of a set of signal samples of the transmitted media signal 
having a dither value in the corresponding dither value interval, 

combine the separate histograms corresponding to the interval into a single 

histogram, 

and 

determine at least a rescaling fiictor based on the combined histogram in order 

to estimate the quantisation step size. 

Claims 2 and 6 are dhected towards also estimating an ofifeet of the 

transmitted media dgnal. 

Claims 3 and 7 are directed towards lescalmg tiie transmitted media signal 

ushig the rescaling £ictQr. 
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aaim 4 and 8 are directed towaids processing &e tescaled signal in order to 
detect or extract the embedded data. 

The present invention has the advantage of using all the information in the 
histograms for Ihe different signal sample values for estimating the quantisation step size. 
Because of the large number of histograms it is fimhermore easy to fimd the periodicity 
between the histograms, which enables a robust determination of quantisation step size. The 
invention is furthermore not dependent on receiving a pilot signal in order to estimate the 
quantisation step size. 

The essential idea of the invention is that the detector of embedded 
information exploits optimally the knowledge it has on dither values corresponding to sample 
positions. In particular it uses its knowledge on which sample positions have the same dither 
value. For all sample positions corresponding to a certain dither value, a (sparse) histogram is 
constructed. These sparse histograms are then combined into a single well-behaved histogram 
from which the relevant scaling parameters can be derived. 

These and other aspects of the invention will be parent from and elucidated 
with reference to the embodiments described hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention will now be explained in more detail in relation to the 
enclosed drawings, where 

Fig 1 shows a block schematic of an apparatus according to flie present 

invention. 

Fig 2 shows a flow chart of a method according to the present invention. 
Fig. 3 shows histograms of a received image signal, which histograms have 
been calculated with the method according to the present invention. 

Fig. 4 shows a curve over a Fourier transform of the histograms in Fig. 3, 
Fig. 5 shows a curve over the phase relationship of the transformed histograms 

in Fig. 4, and 

Fig. 6 shows a computer program product comprising computer program code 

for performing the method according to the invention. 
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DETAILED DESCRIPTION OF EMBODIMENTS 

The inventioii is directed towards estibtnating original scaling factors of a 
received watermadced signal in order to be able to detect or extract a watOTtnaric from a 
received host signal. In order to better understand the invention, some basic concepts about 
QIM (Quantisation Index Modulation) and DC-QIM (distortion compensated Quantisation 
Index Modulation) will now be explained. 

A watermark is according to QIM embedded in a host signal through chocking 
quantisation values on a sampling grid. A watermarking formula for this approach can be 
seen as: 

q= (ROUND(s/D-d-b/N) + d+b/N)*D (1) 

where q is the watermarked signal, s is the original signal, D is tiie quantisation step size, d is 
a dither value in an interval 0 <= d < 1, b is the watemiaik inJformation andN tiie number of 
information symbols in the watermark signal. In many practical applications N is equal to 
two, which indicates a so-called binary alphabet 

The dither is here provided wilh a wide range of values, which in one 
embodiment of the present invention is 128 different values between 0 and L The dither 
value is a pseudo-random variable that is fixed, independent of the information symbol. The 
dither will later be used in order to determine scaling &ctors, which will be described later. 
The reason dither is provided in the watermarked signal is that the watermarked signal q will 
be virtually indistinguishable firom the original signal s, which can be detemiined by studying 
histograms of tiie watermarked and original signals. 

Above a QIM watermarking process was described. A variation of tins is the 
DC-QIM method where the basic quantisation approach is iq[)graded with a distortion 
compensating component. 

A watermarking formula according to this process would then look like: 

qdc = s + a*(ROUND(s/D-d-b/N) + d + b/N - s/D)*D, (2) 

where a is a properly chosen factor between 0 and 1. 

More details about these watermaridng schemes can be found in WO 
03/052689 and in the article "Quantization Index Modulation: A Class of Provably Good 
Mefliods for Digital Watermarking and Information Enabedding" by B. Chen and aW. 
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Women, IEEE Transactions on Information Thwiy, VoL 47, No. 4, May 2001, which 
documents are herein incorporated by reference. 

When a watermarked signal according to any of these two schemes is then 
transmitted to a watermark detector over a channel, it is fairly easy to detect the embedded 
message b in a received signal r, which can be performed according to 

b' = Mod(ROUND(rN/D - NiQ, N) (3) 

i.e. thiou^ dividing the value r by D/N, subtracting the rescaled dither Nd, rounding the 
result and performing a Modulo N operation on the roimded value. 

Here it is assumed that the received signal r corresponds to the watermarked 
. signaJ_q with soi^^ ..... 

In reality there is not only added noise, but there can be a rescaling of the 
original signal. This rescaling can be the result of properties of the transmission channel used, 
which can take place if it is a analogue channel. Such rescaling can also be the result of an 
attack on the watermarked signal by a malicious party. The invention is directed towards 
identifying the rescaling factor of a recdved signal and then it is a simple task to scale the 
signal in order to esthnate the origmal scaling and thereafter identify or extract a watermark 
fiom the restored signaL 

A model for the relationship of the changed signal and the original signal can 

then be set as: 

r = R*(s + 0)+n (4) 

Where R is a multiplicative degradation and O represents an offset in DC 
values. Through the equation: 

r'=r/R-0 (5) 

a new signal r' can be determined from which an embedded watermark must be retrieved. 

In order to describe the preset invention reference will now be made to Fig. 
1, which diows an apparatus for enabling idmtification of data signals and to Fig. 2, which 
shows a flow chart for enabling identification of data signals. The ^aratus 10 comprises a 
receiving unit 12, which receives a watermarked media signal r over a channel (not shown). 
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step 22. The channel can here be an analogue channel in which case the receiving unit can 
include radio circuits. The received signal r is then deHvered to a signal distortion 
determining unit 14, step 24. In the signal distortion determining unit 14, wWch is the core 
element of the invention, there are then performed a number of further steps, which will be 
described next. 

Under fhe assumption that the received signal r is made of a number of 
seniles that can have values in a value range and also under the assumption that the dither 
intervals are known at the watermaric detector ade, the signal distortion determining unit 14 
now first sets i?) a large number of dilher intervals, like 1 28 different intervals that the dhher 
can take up, step 26. Thereafter the signal sanqile values of the received signal are grouped 
according to dither interval, that is all signal sample values having dither wifliin a dither 
interval are groined together. Each dither value interval is here based on only one dilher 
value. In this way a number of different sample groups are provided for each dither interval, 
step 28. A histogram is then determined for all the signal samples of each dither interval, step 
30, such that a histogram is determined or computed for each dither interval. These 
histograms are then combmed into a smgle histogram, step 3 1 . Thereafter the rescaling fector 
l/R as well as oflfeet O ate estimated based on this combmed histogram, step 32. How this 
can be done will shortly be described m more detail. At this point it suffices to say that die 
(typicaUy sparse) separate histograms are combmed mto a single (better behaved) histogram 
and that flie relevant parameters are derived therefixjm. The determined offeet -O is then 
provided firam the signal distortion determining unit 14 to an adding unit 16, which also 
receives the signal r. The addmg unit 1 6 flien adds the offeet -O to the signal r and thus 
subtracts the offeet O ftom the received signal, step 34, and provides the thus adjusted 
received signal to a multiplying unit 18. After the rescalmgfector l/R has been estimated by 
the signal distortion determining unit 14, this factor is also forwarded to tiie multiplying unit 
18. The rescaling fector l/R is then multiplied with the adjusted received signal in order to 
scale the signal, step 36, in order to retrieve the original level or original quantisation step 
size of the watermariced signal. The thus rescaled signal r' is then siq)pUed to a watermark 
detector 20, where watermark detection is performed, step 38. 

How the scale Actors can be determined will now be described in relation to 
Fig. 3, which shows a matrix of a number of histograms made according to the principles of 
the invention for an image having 256 signal levels and 128 dither value intervals with D set 
to 16 andN set to 2. The histograms thus occiq>y a column each. As can be seen the 
combined histograms together provide a number of lines that go fixMn left to right and where 
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these lines are sli^tly angled upwards. The angle is due to the feet that the dither raises Ihe 
level of the signal. Each histogram thus contributes to these lines. By studying Ihe angle by 
which a line is raised, it is possible to determine the scale fector of the received signal and 
jErom that rescale Ihe signal. In the figure aEbnningwindowhasbeenappliedin the vertical 
direction, which explains the dadcening at the top and bottom of Ihe matrix. From index equal 
to 1 to index equal to 1 28 there is phase shift of ND = 2D, From this figure it can be seen that 
the multiplicative degradation is about 0,95. For each dither interval th^ is furthermore a 
clear periodicity. 

Mathematically the histogram matrix of Fig. 10 can be described as: 
h(k,n) = h(n/R-(k/K + op) (6) 



Where h(l<ytt) is the j&equency of sample n for dither interval k, K is the 
number of dither intervals, O is the ofi&et andR the rescaling fector. As each colunm in the 
matrix is a shifted version of any other column and as the periodicity of the signal is most 
easily retrieved m the fi^quency domain a FFT ^Fast Fourier Transform) is ^lied along the 
vertical axis n, but before that a window ftmction w(n) is applied in order to reduce wrap 
around effects. 

The q[)plication of a window function leads to the following equation: 

h'(lyi) = w(n)*h(k^) (7) 

where w(n) is assimied to be sufficiently fest decaying to approximately have h'(k-Hn,n) = 
h'(k,n - m*D/k), Le, shift variance after windowing. Then the vertical Fourier transform is 
applied according to: 

ir(k,v) = Sum_n h'(k,n) exp(-2*7C*j*n*v/M) (8) 
= exp(-2*7C*j*(k/K + 0)*D*R*v/M)H'(v) 

where the size ofihe set ofsignal values is M. For each colunm in Fig. 3, it can therefore be 
seen that the Fourier transform differs only in phase and not in an^litude. An estimation of 
|H'(v)| of the combined histogram h(n) (lying all separate histograms on top of each other) 
can be obtained by averaging |H'(Tc,v)| over the variable k according to: 
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1 H'(v) I « (Sum_k 1 H'Oc,v) | )/K (9) 

This is outlined in Fig. 4, which shows 1 H'(v) I plotted against v. From this 
figure it can be seen that |h»(v)| has strong peaks, corresponding to the periodic behaviour 
5 of flie origmal histograms, where Ihe distance between the peaks has aperiod of RD. The first 
strong peak in the figure corresponds to flie fimdamentel period RD, jfMcb. in the fi»quency 
domain is Ihe fundamental ftequency M*N/(R*D). In flie figure this fisquency is estimated as 
33, from which a fector R = 0.96 can be determined. 

This fundamental frequency can also be used fiw determining the offeet O, 
10 since the phase behaviour of to fundamental frequency (as a fimction of k) is given by: 

Phase(k)/(2*7C) = -(k/K + 0)*N (10) 

In Fig. 5 this phase relationship is plotted as weU as flie best linear 
1 5 q)projdmation (straight line) . It can clearly be seen that from mmunal to maxhnal dither 
index two full cycles are covered. The offeet vahie is estimated at 0.17*D. 

The different units hi Ihe apparatus can be provided in either software or 
hardware. M flie case of software, the signal distortion determinmg unit possibly together 
with fhe adding and multiplying unite can be provided m the fimn of one or more processors 
20 together with corresponding program memory for containmg the program code for 

performing the method according to the invention. The program code can also be provided on 
a computer program product, of which one is shown in Fig. 6 m fhe form of a CD ROM disc 
40. This is just an example and various other types of computer program products are just as 
well feasible. The program code can furthermore be downloaded from a server, peih^s via 
25 the Internet 

Wifb. the present mvention ttiere are several advantages obtained. All flie 
information in the histograms for flie diflEerent signal sample values is used for estimating the 
quantisation step size. Because of the large number of histograms it is fintiiermore easy to 
find tiie periodicity between the histograms, which enables a robust determmation of 
30 quantisation step size as well as offeet The invention is farlhermare not dependent on 

receiving a pilot signal m order to estimate flie quantisation step size. Moreover, the me&od 
is also easily extended to situations where the scaling fector is not constant over tiie range of 
sample values. 
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There are several variation that can be made to the present invention. The 
media signal need not be received in the s^paratus. Instead the ^atatus can fetch the signal 
from a memory. The apparatus need furthermore not include the watermark detector. This 
detection can be performed in another apparatus. The number of dither values used can also 
be varied and is in no way limited to 128. Therefore the present invention is only to be 
limited by Hie following claims. 
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CLAIMS: 



1 . Mefliod of enabling at least identification the ptesence data symbols that have 
been embedded in a media comprising the steps of: 

obtaining a transmitted media signal (r), (step 22), which comprises a possibly 
distorted version of a host signal in which data symbols have been embedded by quantisation 
5 using a certain quantisation step size and to which dither with a set of dither values has been 
added, 

providing several dither value intervals within the set, where each interval 
corre^onds to one or a small number of dither values, (step 26), 

determining a histogram for each dither value interval, where a histogram is 
10 detemiined for all sample values of a set of signal samples of the transmitted media signal (r) 
and having a dither value(s) in the corresponding dither value interval, (step 30), 

combining the separate histograms corresponding to the intervals into a smgle 

histogram, (step 31), and 

determining at least a rescaling factor (1/R) based on the combined histogram, 
15 (step 32), in order to estimate the quantisation step size. 

2. Method according to claim 1, further comprising the steps of estimating an 
oflFset (O) of the transmitted media signal, (step 32), and removing the estimated offeet from 
the signal, (step 34). 

20 

3. Method according to claim 1, further comprising the step of rescaling the 
signal using the rescaling fector (1 /R) in order to at least approximately restore the original 
media signal having ^bedded data, (step 36). 

25 4. Method according to claim 3, further comprising the step of processing the 

rescaled signal (r') in order to detect or extract the embedded data, (step 38). 

5^ Apparatus (10) for enabling at least identification the presence of data symbols 

that have been embedded in a media signal and comprising: 
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a signal obtaining unit (12) arranged to obtam a transmitted media signal (r) 

comprising a possibly distorted version of a host signal in which data symbols have been 

embedded by quantisation using a certain quantisation step size and to which dither with a set 

of dither values has been added, and 

a signal distortion determining unit (14) arranged to: 

provide several dilfaer value internals within the set, where eadi interval 

corresponds to one or a small number of dither values, 

determine a histogram for each dither value interval, where a histogram is 

determined for all sample values of a set of signal samples of the transmitted media signal 

having a dilher value in the corresponding dither value interval, 

combine the separate histograms corresponding to the intervals into a single 

histogr®Ei,.aad. . 

detemiine at least a lescaling fector (1/R) based on the combined histogram in 

order to estimate the quantisation step size. 

6. Apparatus according to claim 5, wherein the signal distortion determining unit 
is fiirther arranged to estimate an offset (O) of the transmitted media signal and further 
comprising a imit (16) arranged to remove the estmated of&et from the signal. 

7. Apparatus according to claim 5, further comprising a multiplying unit (1 8) 
arranged to multiply the rescaling factor (1/R) with the transmitted media signal in order to at 
least approximately restore the original media signal having embedded data. 

8- Apparatus according to claim 7, fiirther comprising a watermark detecting unit 

(20) arranged to process the rescaled signal (r') in order to detect or extract the embedded 
data. 

9. Computer program product (40) for enabling at least identification the 

presence data symbols that have been embedded in a media signal, comprising a computer 
readable medium having thereon: 

computer program code means, to make the computer do, when said program 
is loaded in the coniiputer 
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for an obtained tranmiitted media signal comprising a possibly distorted 
version of a host signal in which data symbols have been embedded by quanlisation using a 
certain quantisation step size and to which dither with a set of dither values has been added, 

provide several dither value intervals within the set, where each interval 
5 corr^onds to one or a small number of dither values, 

determine a histogram for each dither value interval, where a histogram is 
determined for all sample values of a set of signal samples of the transmitted media signal 
having a dither value in the corresponding dither value interval, 

combine the separate histograms corresponding to the intervals into a single 

10 histogram, and 

determine at least a rescaling &ctor based on the combined histogram in order 

to estimate the quantisation step size. 
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ABSTRACT: 



The present invention relates to a method, apparatus and con^uter program 
product enabling at least identijfication the presence data symbols that have been embedded in 
a media signal. A transmitted media signal is obtained (step 22), which con^rises a possibly 
distorted version of a host signal in which data symbols have been embedded by quantisation 
using a certain quantisation step size and to which diflier witii a set of ditiier vahies has been 
added. Several dilher value intervals wilhin tiie set are provided, where each interval 
corre^nds to one dilher value (step 26). A histogram is determined for each interval (step 
30), where a histogram is determined for all sample values of a set of signal ssanaples of tiie 
transmitted media signal and havmg a diflier value in flie corresponding interval The separate 
histograms ate combined and a rescalingfector is determined based on tiie combmed 
histogram (step 32) in order to estimate flie quantisation step size. 
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